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One dimensional intermittent maps with stretched exponential Sxt ~ 5a;oe'^°' separation 
of nearby trajectories are considered. When t — s- oo the standard Lyapunov exponent A = 
X^'Zq In |A/'(a;i)| is zero (M' is a Jacobian of the map). We investigate the distribution of 
A„ = E-ldlnjA/'(a;Oj A", where a is determined by the nonlinearity of the map in the vicin- 
ity of marginally unstable fixed points. The mean of Ac is determined by the infinite invariant 
density. Using semi analytical arguments we calculate the infinite invariant density for the Pomeau- 
Manneville map, and with it obtain excellent agreement between numerical simulation and theory. 
We show that a (Aa) is equal to Krengel's entropy and to the complexity calculated by the Lempel- 
Ziv compression algorithm. This generalized Pesin's identity shows that (Ac) and Krengel's entropy 
are the natural generalizations of usual Lyapunov exponent and entropy for these systems. 

PACS numbers: 05. 45. Ac 05.40.Fb 74.40. De 



I. INTRODUCTION 

In recent years there is growing interest in dynami- 
cal systems which exhibit unpredictable behavior but are 
characterized by zero Lyapunov exponents, namely tra- 
jectories are separated non-exponentially [lH3|. Promi- 
nent examples of such systems are Hamiltonian models 
with a mixed phase space Uj, 141 , systems with long range 
forces Is, certain billiards |6l4lOl|, maps with discontinu- 
ities [ll|, one-dimensional hard-particle gas lia . maps 
at the edge of chaos (Feigenbaums point) [ij, [IJIj gener- 
alized logistic map close to pitchfork and tangent bifur- 
cation points [l5| and maps with marginal fixed points 
such as Pomeau-Manneville map ,18] which was 
used to model intermittency. 

For the Pomeau-Manneville map the separation of tra- 
jectories is described by stretched exponentials dxt ^ 
dxo 6"^°*° with < a < 1 [l^, which is related to 
power law sojourn times in the vicinity of marginally 
unstable fixed point (see details below). Systems with 
stretched exponential separation of trajectories behave 
very differently than normal chaotic ones so the stan- 
dard description of dynamics is limited. Non-Gaussian 
fluctuations [l^, aging [20|, anomalous diffusion [2T| - [23| 
and weak ergodicity breaking [2^ - [27j are found in these 
systems. Physical observables are described by distri- 
butions as for example given by Aaronson-Darling-Kac 
(ADK) and Dynkin-Lamperti theorems [23 - [3l| . In par- 
ticular Akimoto and Aizawa showed that the distribution 
of Xa is given by the Mittag-Leffler function [s^l ■ Closely 
connected with the stretched exponential separation of 
trajectories, the Kolmogorov-Sinai (KS) entropy rate is 
zero since the entropy production increases sub-linearly 
in time (Toj and the relevant measure has infinite invari- 
ant density [33l - [35| (see details below). Hence, there is 
a need to modify basic concepts of chaos theory when 
dealing with such systems. 

A fundamental theorem of chaos theory is Pesin's iden- 
tity [H, [131 • It states that for a closed chaotic sys- 



tem the KS-entropy is equal to the sum of positive Lya- 
punov exponents. For intermittent systems which we 
consider Lyapunov exponents are zero and so are their 
KS-entropies. Hence, the standard Pesin's identity is not 
useful. A natural question is whether Pesin's identity 
could be generalized by relating entropy concepts with 
the separation of trajectories for such systems. For the lo- 
gistic map at the edge of chaos (Feigenbaums point) with 
a power law separation of trajectories fs^ a generalized 
Pesins identity was investigated using Tsallis statistics 
0; l]3- A critical discussion of this approach is given in 
Ref. [231 (and see a reply in [i^l). Note that in this case 
the invariant density is a discontinuous fractal Cantor set 
[in which is different from the absolutely continuous but 
infinite invariant densities inherent in our approach. 

In this paper we are addressing the generalized Pesin's 
identity for intermittent maps with marginal fixed points. 
For the Pomeau-Manneville map an attempt in this direc- 
tion, based on numerical simulations was made in [Zlf. 
However, without the use of the infinite invariant den- 
sity, and without the important concept of Krengel's en- 
tropy [i^ (see details below) conclusions were limited. 
Recently we suggested a generalized Pesin's identity us- 
ing the Pomeau-Manneville map [i^. Particularly, it 
was shown that the average separation of trajectories is 
equal to Krengel's entropy ha', ha = a(Xa). The goal 
of this paper is to provide detailed derivation of general- 
ized Pesin's identity, evidence for it for intermittent maps 
with one and two unstable fixed points, and importantly 
to clarify the meaning of entropy for systems with inter- 
mittency. 



II. MODELS 

We consider two types of one-dimensional discrete time 
maps Xt+i = M{xt) on the unit interval. 
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FIG. 1: (color online) (a) Pomeau-Manneville map Eq. IT]) 
with z — 3 and a = 1, so ^ = 0.6823. Notice the unstable 
fixed point on a; = 0. (b) The map in Eq. ([2]) with z — 3 
has two unstable fixed points on a; = and x = 1. As usual 
M'{x) — 1 for marginally unstable fixed points. 



1) The first model is the Pomeau-Manneville map [18l| 

M{xt) ^ xt + ax^ {mod.l) , z > 1, a > 0. (1) 

The discontinuity point ^ is given by M(^) = 1. A sketch 
of the map is shown in Fig. [T] (a). 

2) The second map is defined as 



M{xt) = xt + 
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< Xt < i 

1 < a;, < 1. 



(2) 



This map has two marginahy unstable fixed points xt = 
and Xt = I as shown in Fig.[T](b). Such intermittent sys- 
tems were analyzed with many different methods such as 
stochastic modeling (TgI [i^ j , renormalizatio n g roup the- 
ory [4^ , continuous time random walks [l^, [231 . periodic 
orbit theory [i^, thermodynamic formalism |47l| and oth- 
ers [13, 13 • For both models the behavior in vicinities of 
marginally unstable fixed points is controlled by 
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z-l ' 



z < 2 
z>2. 



(3) 



At z = 2 there exists a transition from ergodic behavior 
to behavior characterized by weak ergodicity breaking 

Remark: although the expansion of the higher order 
iteration of the generalized logistic map with parameter 
values close to tangent bifurcations, is close in form to the 
Pomeau-Manneville with nonlinearity parameter 2 = 2 
[Tsl . Xn+i ~ Xn + Xn + ^ with e ^ (c = exactly at 
tangent bifurcations points), this system is quite differ- 
ent from the Pomeau-Manneville map. It has faster than 
exponential separation of trajectories 13] . The main dif- 
ference between two systems is that the invariant density 
in the former case is a discontinuous fractal Cantor set, 
while it is absolutely continuous but infinite for the later 
system (ssl - issj . We derive the infinite invariant density 
for the Pomeau-Manneville map explicitly in Sec IIVI 



III. SEPARATION OF TRAJECTORIES 
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For a one-dimensional ergodic dynamical system 
1 = AI{xt) the Lyapunov exponent is defined as 
37 



1 

A= lim -V ln|M'(a;,)| = 

i— >oo t ^ — ^ 

i=0 



dx p{x)\n\M'{x)\, (4) 



where p(x) is the invariant density of the system and 
M'{x) is the spatial derivative of the map. By ergodicity 
the time average is equal to the average over the invari- 
ant density. The existence of the finite limit implies that 
L{t) = \n\dxt/dxo\ = E*=d In |M'(a;,)| oc t. This behav- 
ior is observed for z < 2 (a = 1) as shown in Fig. [2] (a). 
Functions L{t) calculated for different initial conditions 
collapse on a single asymptotic with the slope given by 
the Lyapunov exponent A. 

For z > 2 (0 < a < 1) the behavior of ^'ig In \M'{x^)\ 
is very different (see Fig. [5] (b)). The density function 
of trajectories generated by maps Eqs. (|1I2I) is concen- 
trated on unstable fixed points in the long time limit. 
The derivative |Af'(a;)| at these points is equal to IjSO 
ln|M'(a;)| ^ Inl ~ 0, A = as shown already in jl9| . 
Such a behavior is found since most of the time the 
particle spends in the vicinity of the marginally stable 
fixed points. In this case the separation of trajectories is 
stretched exponential [l^ (see Fig. [3](b)) 



dxt ^ dxo e 



(5) 



For different initial conditions L{t) is a random function. 
The long time behavior of the averaged over initial condi- 
tions L{t) is given by {L{t)) = (E]Zl^^\M'{xi)\) cx ^ 

with < a < 1. 

Using the chain rule and the dynamical mapping 
Xt+i — M{xt), we define 
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K{xo) - -^ln|M'(a;,)|, 

i=0 



(6) 
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tion very close to it = and make the continuous time 
approximation of Eq. ((TJ [l^, , dxt /dt = axf with 
Xt <^ 1. Using this approximation the separation of tra- 
jectories close to unstable fixed point is found to be [l^ 

at) = dxt/dxo = [1 - - "'/^""'^ , (7) 

where xq is the initial condition. In C(t) is shown in Fig. 
[l](b) (divergent line). The short times behavior of InC(i) 
is given by linear in time law 

\nC{t) r--. zx^-H. (8) 

Note that Eq. is valid for tc < [{z ~ l)^^"^]"^ since 
InC(i) diverges at t = tc and is complex for t > tc- More- 
over Eq. ([7|) is derived only for particles starting at t = 
from an initial condition close to 0, namely xq 1, which 
is also the condition for continuous time approximation 
to hold. 

The observed linear separation of trajectories is related 
to aging ^2d\ in the following sense: if we 'age' the sys- 
tem for time ta (that is let the system evolve without 
measurements) and calculate the separation of trajecto- 
ries after ta, we will observe linear in time behavior for 
t <^ ta due to the increased probability for a particle to 
be in the vicinity of the marginally stable fixed points 
after aging. 

IV. INVARIANT DENSITY 



FIG. 2: (color online) Function L{t) = E'Iq In |M'(j:i) 
calculated for different single trajectories of the Pomeau- 
Manneville map Eq. ([l]) with (a) z = 1.7, a = 1 and (b) 
z = 3, a = 1. For later case notice the small time linear be- 
havior (the dotted line is proportional to t) and the long time 
average power law asymptotic (the dashed line is proportional 
to t"). Divergent line represents ln(^(t) with (^{t) given by Eq. 
(O (see the text for more details). 



where the dependence on initial condition is emphasized. 
For z > 2 (0 < a < 1) Aq, does not converge to a constant, 
rather it is a random variable. To prove that a system 
actually exhibits stretched exponential separation of tra- 
jectories, it is sufficient to find the limit distribution of 
Xaixo) and to show that it is not trivial (i.e. not a delta 
function). In Sec. |V] we will calculate the distribution 
of Xa and will use it to define the generalization of the 
Lyapunov exponent. However, first in section HVl we will 
investigate infinite invariant densities of the considered 
maps. 



A. Short time behavior 

Here we investigate the short time linear behavior of 
L{t) oc t (Fig. [5] (b)). To explain this linear behavior 
we consider the particles starting from an initial condi- 



First consider model 1. To obtain its invariant density 
analytically we use the approximation of the map [16, 4^ 
for a; ^ 1, dxt/dt ~ axf , and extend it to be valid on 
the interval (0, ^) where ^ is defined as the solution of the 
equation Af(^) = 1 (see Fig.[T](a)). When the trajectory 
reaches the boundary x = ^ it is randomly reinjected 
back to the interval (0,^). The density function Prix.t) 
of this system is governed by the equation 



ictionpc 

[1,13 



dpc{x,t) 



d 



{ax'pc{x,t))+aCpc{C,t), (9) 



dt dx 

where ^ is teated as a parameter. The subscript c in pc 
is for continuous approximation. The first term on the 
RHS of Eq. © represents deterministic escape from the 
marginally stable fixed point, the second term accounts 
for reinjection of particles. The solution of this equation 
in Laplace space is 



Pc{.x,s) 



r^Ox(s) 



where 

0,(s) = 6(z-l) 



l-(6s)^F( ^3^,65 



(10) 



(11) 



and = (z - 1)^1 a-^x^-\ For < a < 1 (z > 2) the 
small s behavior (equivalent to t — !■ oo) is given by 



Pc{x, s) 



1 



a"r(l 



a] 



(12) 
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Since, bs 



'l/a 



s is the small parameter of the 



expansion, Eq. ([T^ is valid for all x ^ 0. For x = we 
get different expression 

1 1 



Pc(0,s) 



Q;"r(l - a) si+" ■ 



(13) 



In practice there is a crossover from one asymptotic to 
another at some ^ 1 which we define below. Trans- 
forming Eqs. (IT^ [T^ into the time domain and consid- 
ering t oo one gets for < a < 1 (z > 2) 



sin(7ra) 



sin(7ra) 



X ^ Xc 
X <^Xc 



(14) 



We define the crossover Xc as Pc (a;>£i;c)('^c) = 
Pc (2;<2;c)(^c) (see Fig. 131). Using Eq. (fT4| . the time 
dependence of the crossover is obtained Xc = a°'t^°'. 
Hence, the crossover goes to zero Xc — > as i — J> oo. 
For z < 2 we find the following solution for the density 
function 



Pc{x,s) 



(2 - z) a;i-^i, 
(2-^)^, 



and 




X > Xc 



X ^ Xc 
X Xc 



ln{t) ' 



X ^ Xc 



X ^ Xc 
X Xc 



(15) 



(16) 



(17) 



(18) 



Note, that the density function is stationary only for z < 
2 and x ^ Xc (Eq. (ITCl) ). For z > 2 the density function 
depends on time even in the long time limit. Moreover, 
the dependence is of the power law form for < a < 1 
(Eq. ([13])) while it is logarithmic for 2 = 2 (Eq. p^ ). 
We introduce 

{a"~^ sin(7rcK) _ J_ ^ 

(19) 

for < a < 1. For z = 2 (a = 1) the scaling factor is 

Ht) 



Pc{x,t) = ln{t) pc{x,t) 



X • X X' 

i ^ X c 



(20) 



Note that in the long time limit Xc and scaled density 
functions become independent of time pc{x,t) — Pc{x) 



Pc{x) 



a^smO™)^_i 0<a<l, 

x~^ , a = 1. 



(21) 




FIG. 3: (color online) Numerically calculated invariant den- 
sity function for the map Eq. ([l]) with a = 0.3. Uniform initial 
density was used. Curves corresponds to different computa- 
tion times ti = 10\ from bottom to top i = 2,3,4. Dashed 
lines correspond to Eq. (|19|l with no fitting parameters. The 
Xc represents the crossover from one asymptotic to another. 
Note, that Xc decreases with time and limt^oo Xc(t) — 0. For 
X ^ Xc p(x) ~ x'^^" yields an infinite invariant density. 



For all a the scaled densities have power law decay in x, 
Pc{x) '-^ x~^/", and their integrals diverge for < a < 1 
(when we take the long time limit Xc — 0) 



dxpc{x) 



00. 



(22) 



Thus, Pc{x) is not normalizable. Still, as we show later, 
the infinite invariant density is useful for the calculation 
of the statistical properties of the dynamics. 

We perform numerical simulations and obtain the in- 
variant density of Eq. ([T]) comparing it with the density 
function obtained analytically. In these simulations we 
start with a uniform density and plot p(x) = t^~°'p{x,t) 
versus x. Results are shown in Fig. [3] The analytical 
solutions of the continuous stochastic model Eq. (fTO)) are 
plotted as dashed lines. We find excellent agreement be- 
tween continuous model Eq. ([9]) and numerics without 
fitting. Horizontal lines represent asymptotic solution for 
X ^ Xc calculated for the corresponding time of the sim- 
ulation, while the sloping line corresponds to the asymp- 
totic solution for x ^ Xc which decays as x~~. The Xc 
represents the crossover from one asymptotic to another. 
As t — 00, Xc ^ and we approach the infinite invariant 
density. 

For the second model Eq. ^ with two marginally un- 
stable fixed points an example of numerically calculated 
invariant density function for a ~ 0.3 is shown in Fig. 
m The invariant density function in this case is well ap- 
proximated by 



p(x) 



-l-a (1 -x) ° -1-6, 



(23) 



5 




1.5 



1,0 



- 0,5 



0,0 



2000 



4000 



FIG. 4: (color online) The same as in Fig. [3] but for the map 
Eq. ((2| with a — 0.3. Curves corresponds to different com- 
putation times t = 10' from bottom to top i = 0, 1, 2, 3, 4, 5. 
Dashed line is the best fit (see Eq. ([23} )■ We have p{x) ^ 



-I/O 



for 



and p{x) ~ {1 - x)'^/" for 



1. Thus, 



non normalizable infinite invariant density emerges. 



where a = 0.04 and & = 1 for a = 0.3. In this case the 
infinite invariant density has two peaks on x = and 
a; = 1 corresponding to two unstable fixed points. As 
before Jq dx p(x) = oo. 



V. GENERALIZED LYAPUNOV EXPONENT 

Now we return to the investigation of distribution of 
Aq for z > 2 (0 < a < 1). This problem can be treated 
using the AKD theorem [H, [2^ [s^ , as pointed out in 
[3^ . however we feel that a rederivation using stochastic 
arguments is useful. We consider the logarithm of the 
derivative of the map y — ln|M'(a;t)| illustrated in Fig. 
[5] for a single initial condition. Then we define a two 
state process I{t) = if y < 5' and I{t) — 1 if y > S, 
where 5* denotes a threshold. Waiting times in state 
are distributed according to power laws with an infinite 
sojourn time [13, HI] (see details below), while waiting 
times in state 1 have a characteristic average time. Ig- 
noring therefore times spent in state 1 and neglecting 
correlations we consider I{t) as a renewal process. Let n 
be the number of renewals which occur in time t, namely, 
number of transitions from state to 1. The logarithm 
of the derivative of the map In |Af'(a;f)| is equal to zero 
most of the time since the trajectory stays for long times 
near marginally unstable fixed points, only for short pe- 
riods its value deviates from zero (see Fig. [S]). The sum 
of logarithms along the trajectory is thus proportional to 
n: X]i=o [-^^'(-^i)! c n, where c is a constant, which 
according to the renewal theory poj is a random variable. 
Our goal is to calculate the pdf of Aq. Eq. ^ . Note that 



FIG. 5: Illustration of the renewal process I{t) defined by 
ln(|A/'(a;t)|) for the map Eq. ([TJ with a = 0.3, a = 1. The 
dashed line is a threshold S which is chosen to be the discon- 
tinuity point of the map Eq. ([T]), S = ^. 



the distribution of 'standard' local Lyapunov exponent 
A = y^* Zn In \M'(xi) \ /t (where t is finite) was investi- 
gated in |50[. This probability density function (PDF) 
was found to consist of a smooth part that vanish as 
t — > 00 and a peak at x = (corresponding to A — as 
t — > 00). 

The probability to have exactly n renewal events in 
time t can be expressed through the waiting time distri- 
bution as well known [i^. It is calculated as follows: the 
PDF of time intervals between renewals can be obtained 
from the continuous approximation of the maps near 
marginally unstable fixed points dxt/dt ~ ax^ . Solving 
this equation one finds the duration of laminar motion 
as function of initial condition xq 2^] 



a 

t = - 

a 



1 



(24) 



The PDF ■0(i) of the waiting times is thus related to the 
distribution Pin{xo) of injection points which we assume 
to be uniform Pin{xQ) = 1, ip(t)dt = Pin{xo)dxo, imply- 
ing [2| 



iP{t) ^ A/t'+°', t 



00, 



dt e-''^i>[t) ~ 1 - Ss", 



0, 



(25) 



(26) 



where il){s) is the Laplace transform of ilj{t) and A, B 
are some positive constants. Let P„(i) be the probability 
of having n renewal events in (0,t) and Pn{s) it Laplace 
transform. Using convolution theorem [49i] 



^^"(s) (l-V^(s) 



(27) 
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Since for the calculation of the distribution of Aq. (Eq. 
([5])) one needs to have the unknown constant c, we pro- 
ceed to the rescaled variable C = ^a/ {^a)- Here (A^) 
is the mean value of A^ which we calculate later. Ac- 
cording to the renewal assumption, ^ = n/ (n). Using 
Eq. (1291) the mean number of renewal events is given by 
~ Br{i+a) • change of variables we arrive at the 
PDF of rescaled variable ( 



P (O - 1 ^ ^ ' 1 



ri/"(l -t-a) 



(30) 



This is the first main result of the manuscript which is 
a special case of the more general ADK theorem 28 , [2^, 
[33} . This result was obtained previously in Ref. 32 | , as 
mentioned. One can also express Eq. pop in terms of 
the Mittag-Lcfflcr PDF [4i,[5l|. To get the distribution 
of Aq we change variables again, using C = Aq / (Aq) and 
Eq. ^ 



1 



By definition (Aq) is given by 



/•OO 

/ Aq /'q(Aq) dXa- 

Jo 



(31) 



(32) 



For z < 2 we have a — 1 (see Eq. ([3])) and the distribution 
of finite time Lyapunov exponent is the delta-function 
Pi(Ai) = (5(Ai — A) and (Ai) reduces to the standard 
Lyapunov exponent Eq. (|4]). 

Now we calculate the average (Aq), which is the main 
new result of this section. Using Eq. (|6]) 



FIG. 6: (color online) (a) Numerically calculated PDF of 
Aq for the map Eq. ^ with a — 0.75, 0.59, 0.5 calculated 
with 10^ trajectories iterated for t — 10^. Smooth curves 
(which coincide with numerical data without fitting) corre- 
spond to analytical PDF Eq. (|3ip with (Aq) calculated with 
Eq. pS]) . (b) The same as in (a) but for the map Eq. ((2]) with 
a = 0.75, 0.5, 0.3 from top to bottom calculated with lO" tra- 
jectories iterated for t — 10* for a — 0.75, 0.5 and t — 10^ for 
a = 0.3. Smooth curves correspond to analytical PDF Eq. 
(|3ip with (Aq) calculated numerically using Eq. H37p . 



For small s corresponding to large t one obtains 



Pnis) 



(28) 



The inverse Laplace transform of Eq. (|28l) can be ex- 
pressed in terms of one-sided Levy PDF |49| 



Pn{t) = 



1 



t 



a n 



1 + 1/q J^l/a 



t 



[Bn) 



1/q 



(29) 



where the one-sided Levy PDF is defined through its 
Laplace transform la{s) = exp{—s°'). 



(A„) 



p{xq) dxQ, (33) 



where the averaging is over initial conditions distributed 
according to some initial density p{xo). Since we are in- 
terested in the long time limit we replace the summation 
with an integral and average over the density function 



(Aq)^1 f\x f\n\M' 

Jo Jo 



ix)\ pix,t') dt'. (34) 



For Pomeau-Manneville map Eq. ([T]) the density function 
has two asymptotics valid for x <^ Xc and x ^ Xc Eq. 
(IT41) . Hence, 

(^") - i / / ln|M'(a;)| (x, i') dt'+ 



(35) 



— dx \n\M'[x)\ p^^^^^){x,t')dt', 

t Jxc Jo 



where Xc denotes the crossover from one asymptotic 
of p{x,t) to another (see Fig. The crossover Xc 

was defined in the previous section as P{x'»x^){xc) = 
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V 




integral over time and noticing that °'p{x,t) = p{x) 
(Eq. m])), we obtain the final result 



dxln|M'(a;)| p{x). 



(37) 



Since ln|M'(x)| vanishes precisely where the invariant 
density has divergences, the integral is finite and positive 
in spite of the fact that the integral of p{x) diverges. 
Eq. (|3T|) together with Eq. (|37)) fully characterize the 
distribution of generalized Lyapunov exponents in the 
non ergodic phase. Eq. ([571) is our second main result, 
and we claim that it is valid for systems with unstable 
fixed points and not limited to Pomeau-Manneville map. 
For the stochastic model Eq. ^ with < a < 1 using 
Eq. (fTO|) one gets for the map in Eq. ^ 



V 
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(b) 




FIG. 7: (color online) (a) Symbols represent (A^) calculated 
by Eqs. p2l37p for the map Eq. Solid line is {\a) calcu- 
lated with analytical infinite invariant density Eq. (|38p . (b) 
Symbols represent the same as on the top panel but for the 
map Eq. Q. Dashed line is the standard Lyapunov exponent 
A Eq. (gl). 



P(x^Xc){^c)- Using Eq. (jl4p . — a'^t"" and as t — >■ oo, 
Xc 0. As a result the first integral vanishes in the 
long time limit. The fact that this integral vanishes 
is not trivial since P(x<i::xa) ^ ^ (^^e Eq. (1141) ). it 
happens because we consider a specific observable with 
In |M'(a:)| as a: — > 0, which cancels the t" divergence 
found in Eq. (jl4p . Using the density function in the form 
p{x,t) ~ C t°'^'^/x^^°' for x > (Eq. dH])), we arrive 
at 



1 



(36) 



where C is a positive constant. For the analytical approx- 
imation of the map studied in Sec. lIVI constant C is given 
hy C = ""'"'^W^") (Eq. (mi)). Finally, computing the 



1 f a"" 
(Ac) = - / dx — 
a Jo a° 



sin(7ra) ln(l -|- azx 



Ala 



(38) 



When z — >• 2 (i.e. a — >■ 1) (A^) ~ since then we 
approach the normal phase, for z — > oo (i.e. a 0) 
(Aq) z. 

Distributions of Aq obtained by simulation of maps 
Eqs. (|ll2p are shown in Fig. |6l Smooth curves corre- 
spond to analytical PDF Eq. (|3T1) with (Aa) calculated 
numerically according to Eq. ([37]) . The perfect agreement 
between theory and simulation indicates that the general 
theory works well for finite time simulations. The figure 
demonstrates that one-sided Levy distributions describe 
scaled finite time Lyapunov exponent also for maps with 
two marginally stable fixed points. 

Numerically computed generalized Lyapunov exponent 
is shown in Fig. [7] For the map Eq. ([T]) (Fig. [7| (a)) we 
find good agreement between (Aa) calculated with the 
approximate analytical infinite invariant density Eq. (j38p 
and numerically computed one. The convergence of (Ac) 
is getting worse for z close to z = 2 because of the slow 
logarithmic convergence to the invariant density at z = 2. 
Also the convergence is getting worse for large z (small 
a). In the ergodic phase z < 2 the standard Lyapunov 
exponent Eq. ([Ij) is recovered. In particular, for z = 1 
the analytical value A = ln(2) is obtained [33|- In the 
non ergodic phase z>2(0<q;< 1) the generalized 
Lyapunov exponent is finite while the standard Lyapunov 
exponent Eq. ([3|) vanishes. 

For the second model Eq. ^ the behavior of (A^) is 
qualitatively the same (Fig. [7| (b)). Solid line here rep- 
resents the standard Lyapunov exponent which vanishes 
for z > 2. 



VI. KRENGEL'S ENTROPY AND PESIN-TYPE 
IDENTITY 

The entropy for infinite measure preserving 
transformations was introduced by Krengel as the 
Kolmogorov-Sinai entropy of its first return map (FRM) 
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times the integral over the invariant density [42 



tiKsiRA) / dxp{x). 
J A 



(39) 



The FRM Ra is defined on any subset A of finite measure 
as M'^(^)(a;), where t{x) = l+n{x) and n(x) is the smah- 
est positive integer such that M" G A [S^- An example 
of the construction of the FRM for the Manneville map 
Eq. (P) with A = 1] is shown in Fig. [8] (a). AU trajec- 
tories starting in Ai are mapped into A already in one 
iteration, so n{x) = 1, t{x) = 2 and Ra{x) = M{M{x)). 
All X ^ A2 are mapped into Ax and after that from Ai 
to A, so nix) = 2, tIx) = 3 and Ra{x) = M{M{M{x))). 
The FRM map Ra{x) has infinite number of branches 
accumulating for a; ^ 0. The slope of all branches is 
strictly greater than 1. Hence, the FRM is everywhere 
expanding and therefore has finite invariant probability 
density, positive Lyapunov exponent and Kolmogorov- 
Sinai entropy, ha does not depend on the choice of A 
[53} . Fig. M (b) shows how the FRM is modified when A 
is increased to [0.4,1]. Although the integral J^dxp{x) 
is increased compared to the case A = the FRT 

map and its hKsiR-A) is also changed to compensate this 
increase. 

Krengel's entropy ha satisfies Rohlin's formula [33.153- 
M 



ha^ / in \M'{x)\ p{x) dx, 



(40) 



where p{x) is the infinite invariant density. Comparing 
Eq. (|40p with Eq. ([37]) we find that up to a constant 
a, Krengel's entropy ha is equal to our generalized Lya- 
punov exponent (Aq) calculated with the invariant den- 
sity 



ha = a (Xa) 



(41) 



Thus, unlike h^s entropy in the non ergodic phase the 
Krengel's entropy of the system ha is nonzero and pos- 
itive. Moreover, up to a factor a it is equal to the Lya- 
punov exponent that generalizes the Pesin's identity. 

What is the Physical meaning of the Krengel's en- 
tropy? To answer this question we consider complex- 
ity of a single trajectory calculated by Lempel-Ziv algo- 
rithm LZ77, which originates from the data compression 
and characterizes degree of randomness in a system (STj . 
Briefiy the algorithm can be described as follows: in the 
first step the signal is transformed into binary sequences. 
We have used threshold — 1 coding assigning '0' for 
X < ^ and '1' for X > 5 (see Fig. [1] where ^ is defined 
for the map Eq. ([T])). The sequence S = siS2.-., (where 
Si is '0' or '1') is sequentially scanned and rewritten as a 
concatenation of words wiW2--- chosen in such a way that 
wi — si and a new phrase Wk+i is formed by the longest 
match anywhere in a past, plus the new symbol. In other 
words, Wk+i is the extension of some word Wj in the list, 
Wk+i = WjS, where < j < fc, and s is either or 1. The 
corresponding compressed code consists then of pairs of 




a: 




FIG. 8: (color online) (a) The map M{x) in Eq. HJ with 
z — 3, a — 1 (dashed line) and its first return map (FRM) 
Ra{x) with the return interval A — [^,1]. (b) Ra{x) for 
A= [0.47, 1]. 



numbers: an indicator being a pointer to the previous 
occurrence of the prefix of the word and the last bit of 
the word. As an example consider the string S which is 
decomposed into words as follows: 

S ^ 00011110101... = (0)(00)(1)(11)(10)(101)... . (42) 

Let c{t) denote the number of words in the sequence. 
In the above example c{t) = 6. For each word, we use 
log2 c{t) bits to describe the location of the prefix to the 
word and 1 bit to describe the last bit. The information 
content of the string, I^z, is defined as the total length 
of the encoded sequence 



Ilz - c{t) [log2 c{t) + 1] 



(43) 



(Note, when t ^ 00 the 1 is negligible and Ilz = clogj c 
resembles the Shannon entropy.) The complexity of the 




FIG. 9: Information content {Ilz) calculated by the Lempel- 
Ziv algorithm for the map Eq. ([T| with a = 1, z = 2.68 
(a = 0.59), z = 2) {a = 0.5) and z = 3.5 (a = 0.4) average over 
10^ trajectories. Dashed lines correspond to {Ilz) ~ hat" 
with ha calculated by Eq. (|40)l . 



sequence for LZ77 algorithm is related to the length of 
the associated encoding via [s^l: 



Clz = hm 



t 



(44) 



For a stationary dynamical system with finite invariant 
measure and positive Kolmogorov-Sinai entropy h^^s the 
complexity of a string is [11] 



(45) 



Thus, Eq. (|44p can be used to estimate the Kolmogorov- 
Sinai entropy Hks [13 • 

Here we apply LZ77 algorithm to estimate entropy for 
intermittent systems. For the Pomeau-Manneville map 
Eq. (m the average of the information content was shown 
to grow as (6^ |6l| 



(Ilz) 




(46) 



where a = l/(z — 1). Numerical simulations shown in 
Fig. [3] are in agreement with Eq. (pS)) . The coefficient of 
proportionality is given by the Kolmogorov-Sinai entropy 
for z < 2 and by Krengel's entropy Eq. (HUl) calculated 
numerically (see the text bellow). 

Now, we define the complexity of the Lempel-Ziv algo- 
rithm as 



C 



LZ 




(47) 



In the ergodic phase, z < 2, Clz converges to the 
limit and the average of complexity is equal to the 



FIG. 10: (color online) The PDF of C = Clz /a {Xa) for the 
map in Eq. ([1} with a = 0.75 and a — 1. Here 10"" trajectories 
were iterated for t = 10^. Smooth solid line corresponds to 
analytical density Eq. (26). 



Kolmogorov-Sinai entropy, see Eq. (j45p . In the non er- 
godic phase, z > 2, Clz does not converge to a constant 
but remains a random variable. For the map in Eq. ([T]) 
the distribution of the scaled variable ( — Clz/o- (Aq) 
is given by the one-sided Levy PDF Eq. ([50)1 as it was 
shown in Ref. [63|. Numerically calculated PDF of C, is 
shown in Fig. (jlOp . The average complexity in this case is 
given by {Clz) = ha, where ha is the Krengel's entropy 
[55| . Using this the Krengel's entropy can be interpreted 
as an average speed of the information creation by the 
system. Combining it with Eq. (PT|) . we get 



{Clz) ^ ha = a {Xa) ■ 



(48) 



Generalized Pesin's identity Eq. p8)) shows that the av- 
erage speed of the information creation by the system is 
equal to the average speed of separation of trajectories 
for intermittent systems. 



SUMMARY AND DISCUSSION 

1) For the Pomeau-Manneville map Eq. ([T]) with one 
unstable fixed point [19i] and for the map with two un- 
stable fixed points Eq. (2) the separation of trajectories 
is given by dxt ^ dx^e^"'^ . The PDF of scaled Xa/ (Aq) 
is given by one-sided Levy PDF Eq. (j30[) in agreement 
with ADK theorem 32]. 

2) For < a < 1 (2: > 2) the measure is non normal- 
izable and has infinite invariant density which is calcu- 
lated semi analytically for the Pomeau-Manneville map 
Eq. (17) and numerically for the map with two unstable 
fixed points. 

3) The average of Aq. Eq. (34) is found using the infinite 
invariant density for < a < 1 (z > 2). In contrast when 
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a = 1 {z < 2) the Lyapunov exponent is determined by 
the normahzable invariant density Eq. (4). 

4) Standard concept of KS-entropy breaks down. The 
proper entropy Js the Krengel's entropy of the first return 
map Eq. (36) 

5) The scaled Lempel-Ziv complexity Clz/o: {^a) is 
a random variable distributed according to the one-sided 
Levy law j62|. The average complexity of the Lempel-Ziv 
algorithm is equal to the Krengel's entropy (Clz) — ha- 

6) The Krengel's entropy and the average complexity 
of the Lempel-Ziv algorithm are related to the average 
(A„) Eq. (45). 

7) Systems with zero Lyapunov exponents exhibit non- 
exponential separation of nearby trajectories [3, 0413 ■ 
Most of these examples have sub-exponential (namely, a 
power law) separation of trajectories, except the gener- 
alized logistic map close to tangent bifurcations, where 
trajectories separate faster than exponentially [l5|. It 
would be interesting to investigate possible generalized 
Pesin's identity for such systems. 

(8) Very recently the distribution of time averaged 
mean square displacements of the stochastic continuous 
time random walk (CTRW) processes was shown to be 
described by an equation similar to Eq. (27) [6^. Re- 
lation of the CTRW model and intermittent dynamical 
systems is well established [H, 111] . We expect that the 
distribution of time averaged mean square displacements 
in open intermittent systems [22, 23] will follow Eq. (27). 
Thus, the universal fluctuations of generalized Lyapunov 
exponents (Fig. 6) and complexity of the Lempel-Ziv al- 
gorithm (Fig. 10) could be found also in open systems 
and for other observables. More work in this direction is 
needed. 



of this map valid for small x„ is 

x"", X < 1. 



dx 
Hi 



(50) 



Consider the following stochastic model of the Pomeau- 
Manneville map: a particle is moving in the laminar re- 
gion X £ (0,f) according to the equation of the motion 
Eq. ([50l) . At the boundary a; = ^ it is reinjected back to 
a random position in (0,^). One can write the equation 
for the evolution for the probability density p{x,t) 



dpix,t) 
dt 



■^{ax'p{x,t))+Sit), (51) 



where S{t) is chosen to fulfill conservation of normaliza- 
tion, namely dx p{x, t) — const, independent of time 



dt 



which gives 



d 

= dx —{ax^' p{x,t)) + S{t) / dx, 

Jo ox Jo 

(52) 



Sit)=aepi^,t). 



(53) 



S{t) is a source term which according to Eq. ([53)) depends 
on the probability of finding a particle at time t on x = ^. 

Now we solve the non-homogeneous Eq. ([?T|) with 
< a; < ^ and with initial condition p{x,0) = It 
is easy to verify that the solution of the corresponding 
homogeneous equation with < x < ^ is 



Ph{x,t) 



[1 + a{z - l)tx^'^y 



(54) 



Hint: Eq. ([50]) has the solution 
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x{t) = [xl''' - a{z - l)t\ , 

which is valid for not too long time t < Xq~^ /{a{z — 1)). 
Assuming the uniform initial distribution of xq, one find 
the density of particles for x ^ 1 in the form of Eq. (|54l) . 
This density is not normalized since it does not include 
the effect of the source S{t). 

Let us rewrite Eq. ([5l)) in the form 



Ph{x,t) ^ T'o^At), 



(55) 



where 



APPENDIX 

In this Appendix we solve the non-homogeneous Eq. 
([9]). The Pomeau-Manneville map Eq. ([T]) has the form 



M{Xn) 



axt, I mod 1, 



(49) 



O^t) 



[l + a(z-l)te^ 



(56) 



The Laplace transform of Ox{t) is given by Eq. (fTT|) . Ac- 
cording to Duhamel's principle, a particular solution of 
the non-homogeneous equation is given by the convolu- 
tion of the homogeneous equation with function S{t) = 



with a > and z > 1. The map is discontinuous at 
X = ^, where ^-|-a^^ — 1. The continuous approximation 



Pp{x,t) 



dTS{T)ph{x,t - t). 



(57) 
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The general solution of the non-homogeneous equation 
Eq. ([5T|) is the sum of the particular solution of the non 
homogeneous equation and the solution of homogeneous 
equation 

p{x,t) = pp{x,t) + pi,{x,t). (58) 
Taking the Laplace transform of the solution, we get 
p{x, s) = pp{x, s) + ph{x, s) = 

-ar"'p(e,s)0.(s)+r'0,(s)- (59) 
For X = one find 



(60) 



1-0^-^05(5) 
Substituting this into Eq. (j59p . we finally obtain solution 



presented in Eq. (|T0] 



p{x, s) = 



Using Eq. ([TT|) . we find 



r^o.(g) 
1-0^-^05(3)' 



(61) 



« ~ 1 
dxO^s) = - U-aeO^{s) 



(62) 



which, together with Eq. (|6ip . allows to check for the 
normalization 



S 1 
dxp{x, s) — —. 



(63) 
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